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METHOD FOR IMPLEMENTING DUAL LINK LIST STRUCTURE TO 
ENABLE FAST LINK-LIST POINTER UPDATES 



BACKGROUND OF THE INVENTION 

This invention relates in general to a methodology for optimizing the 
allocation of free memory blocks using link lists and, more particularly, to a 
method and implementation of a dual link list structure for free memory. 

Conventional link lists methods of data storage for shared memory, i.e., 
5 volatile or random access memory (RAM), require that the link list be read 
every time a block of memory needs to be allocated. These methods typically 
determine a free list, a link list defining a block of available memory, when the 
head-tail pointer is established and when a block of memory needs to be 
allocated. Allocation of memory using this process takes longer than the time 

10 available in some pipelined architectures. 

Another method to process memory allocation is described in U.S. 
Patent 6,049,802 to Waggener and Bray entitled "System And Method For 
Generating A Linked List In A Computer Memory 1 '. This patent discloses link 
lists that contain several key list parameters. A memory manager determines 

15 to which link list the data belongs based on key list parameters. This patent 
also discloses that the address of the next location in the link list is 
determined before data is written to the current location. While this allows the 
next address to be written in the same cycle in which data is written, the free 
list scheme disclosed does not address optimization for the allocation and 

20 management of free memory blocks. The method of the '802 patent appends 
and maintains a single free list. 

One more memory storage technique is described in U.S. Patent 
5,303,302 issued to Burrows entitled "Network Packet Receiver With Buffer 
Logic For Reassembling Interleaved Data Packets". In this patent, a network 

25 controller receives encrypted data packets. A packet directory has an entry for 
each data packet stored in a buffer. Each directory entry contains a pointer to 
the first and last location in the buffer where a corresponding data packet is 
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stored along with status information for the data packet. A method is also 
disclosed for partial data packet transmission management for the prevention 
of buffer overflow. Processing optimization for the allocation and management 
of free memory blocks is not achieved in this method. 
5 In addition, neither of the above patents addresses the issue of an 

allocation and a free list occurring concurrently. In that case, extra memory 
bandwidth is required to both do the allocation step of reading from the free 
list and then splicing onto the free list. 

SUMMARY OF THE INVENTION 

Among the several features and advantages of this invention is the 

10 optimization of free memory allocation processing. In some systems, it takes 
longer to read memory than the time available to allocate memory. In 
accordance with one embodiment of the present invention, a method is 
disclosed for free memory allocation in a linked list memory scheme. Free lists 
are link lists designating available memory for data storage. This method 

15 leverages the ability to read memory while concurrently updating a pointer to 
the next location. Multiple free lists are used to reduce the number of cycles 
necessary to allocate memory. The number of entries in each free list is 
tracked. When memory becomes available, it is spliced into the shortest free 
list to achieve balance between the free lists. The free list structure disclosed 

20 consists of head, head + 1, and tail pointers where head + 1 is the next logical 
address pointed to from the head pointer location. The free list consists only 
of the head and tail pointers. Each link list structure of memory to be freed 
contains the head, head + 1, and tail pointers. This allows us to 
simultaneously allocate and free with only 1 memory cycle. This structure 

25 provides the ability to free and allocate memory for further processing without 
executing the allocate step. A whole logical data packet can be spliced into a 
free list in one processing cycle. Utilization of the dual link lists reduces the 
bandwidth requirements for free memory allocation. Balancing of these dual 
lists is achieved by splicing a freed block of memory into the shortest list. The 

30 splicing method disclosed also reduces the processing cycles necessary to 
allocate and free memory. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The features of the invention believed to be novel are specifically set 
forth in the appended claims. However, the invention itself, both as to its 
structure and method of operation, may best be understood by referring to the 
following description and accompanying drawings. 
5 FIG. 1 is a state diagram indicating the alternate processing supporting 

dual free lists. 

FIG. 2 is a block diagram of the link list structure of memory to be 

freed. 

FIG. 3 is a block diagram depicting memory splicing. 

DETAILED DESCRIPTION OF THE INVENTION 

m 10 The method disclosed is for data storage in a linked list memory 

O scheme. Link lists are typically used to partition computer memory chaining 

pi 

K data together regardless of the physical storage location. Each storage 

P'j location for a link list consists of a pointer field and a data field. The pointer 

Ifi field stores the address for next memory location for the chain of data. The 
H 15 data field contains actual data at the current location in memory. Link lists 

1+ designating memory that is available for data storage are referred to as free 

W lists. 

?l f 

U Conventional processing for memory allocation requires that the free 

f°* list be read every time a block of memory gets allocated. This approach is 

20 performed in two-steps. The first step requires reading the free list (i.e.., 
available memory) head pointer to determine the beginning location of 
memory to be allocated. Once the head pointer is determined, the second 
step reads the entry at this head pointer establishing a new head pointer for 
the free list. Using this sequential processing scheme takes longer to 
25 determine the new head pointer than the rate allowed to allocate blocks of 
memory in a pipelined architecture (i.e., the memory allocation rate is less 
than the time required to read the memory). 

One embodiment of the disclosed method utilizes a dual free list 
structure to address these bandwidth constraints in a pipelined architecture. 
30 Using a dual free list structure alleviates the sequential processing 
dependency for memory allocation. FIG. 1 is a state diagram that illustrates 
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the processing for these two free lists. This method leverages the ability to 
read memory while concurrently updating a pointer to the next location. As 
shown in the first state 100 of the diagram, the head pointer of the first free list 
is read concurrently with executing an allocation of a block of memory from 
5 the second free list. The alternating state 101 reads the head pointer from the 
second free list while concurrently allocating a block of memory from the first 
free list. Using this method, processing is optimized to only one processing 
cycle. 

In one example using a particular type of RAM, it takes 45 
10 nanoseconds to read memory but only 37 nanoseconds are available to 
allocate a new block of memory. One important note is that the time required 
to read the RAM is a latency problem. While the latency to read the RAM is 
45 nanoseconds, a read can be completed every 7.5 nanoseconds. Since 
there are two free lists to allocate from, the time available to allocate memory 
15 from a single free list doubles (i.e., becomes 75 nanoseconds). The 45 
nanosecond read rate can now be accommodated. Employing the 
conventional two-step sequential processing approach would not be fast 
enough to meet these throughput requirements. 

The method disclosed also optimizes processing by utilizing the 

ft s 

pi 20 structure depicted in Fig. 2 for link lists that are to be freed. The structure 
N consists of a head pointer 200, a head + 1 pointer 201, and a tail pointer 202. 

/I The head pointer 200 provides the next address 203 in the link list. The head 

+ 1 pointer 201 is associated with the second address 204 in the chain. The 
tail pointer 202 is associated with the last address in the link list 206. 
25 Additional address pointers such as next address 205 are logically chained 
together in the link list structure. 

The memory allocation step can be skipped using this link list structure, 
which optimizes processing throughput. As noted earlier, the sequential 
processing for memory allocation typically consists of first reading the head 
30 pointer of the free list to determine the beginning of the free (i.e., available) 
memory. Then, reading the entry at the head pointer, which provides the new 
head pointer for the free memory list. Using the unique free list structure 
defined obtains the new head pointer for free memory (i.e., the head + 1 
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pointer 201) at the same time it reads the head pointer. Therefore, the 
allocation step is skipped because the new head pointer for free memory has 
already been established (i.e., the new head pointer is the head + 1 pointer 
201). 

5 This method employs two free lists where memory is constantly being 

allocated and freed. A balance is maintained between these free lists by 
tracking the number of entries in each list. As memory blocks are freed, they 
are spliced into the free list that contains the smallest number of entries. The 
link list structure of Fig. 2 is also leveraged to optimize splicing memory that 

1 0 becomes available for insertion into a free list. 

Free pages are always allocated from head and spliced to tail. This 
allows non-coherent access for allocating a head pointer and adding to the 
tail. FIG. 3 depicts splicing memory to be freed into the free list structure. The 
free list 300 consists of the head pointer 301, which provides the first address 

15 303 available. The data structure supports subsequent addresses 304. The 
last address 305 is the tail pointer 302 of the free list 300. 

When memory is to be freed, it is spliced into a free list. Using the head 
pointer 200, head + 1 pointer 201, and tail pointer 202 permits a whole packet 
to be spliced into the free list in one operation. To splice a memory packet into 

20 the free list 300, the free list tail pointer 302 becomes the head + 1 pointer 201 
and the tail pointer of the memory structure to be freed 202 becomes the new 
tail pointer 302. 

For example, a packet of memory consists of 10 blocks. The current 
state of processing requires the 10 blocks of memory be freed and a block of 

25 memory be allocated. The first block of memory in the packet will be allocated 
and the remaining 9 blocks will be freed. This is achieved in one operation 
where the head pointer 200 becomes the first location in memory that is 
allocated; and the head + 1 pointer 201, the second pointer get spliced into 
the existing free list along with the tail pointer 202. The tail pointer 202 

30 becomes the new free list tail pointer 302. Therefore, everything from the 
head + 1 pointer to the tail pointer becomes freed memory. Splicing from the 
head + 1 pointer to the tail pointer puts the whole packet except for the first 
block into freed memory saving memory processing cycles. Applying this 
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method ensures that the simultaneous allocation and freeing of memory is 
never encountered. Memory is either being allocated or freed but never both 
at the same time. A link list is considered "empty" when it contains a single 
entry. 

While only certain preferred features of the invention have been shown 
by way of illustration, many modifications and changes will occur to those 
skilled in the art. It is, therefore, to be understood that the present claims are 
intended to cover all such modifications and changes, which fall within the 
true spirit of the invention. 



